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Abstract. In this paper we investigate the use of the 2D Navier- Stokes- Voight (NSV) 
model for use in algorithms and explore its limits in the context of image inpainting. We 
begin by giving a brief review of the work of Bertalmio et. al in 2001 on exploiting an 
analogy between the image intensity function for the image inpainting problem and the 
stream function in 2D incompressible fluid. An approximate solution to the inpainting 
problem was then obtained by numerically approximating the steady state solution of the 
2D Navier-Stokes vorticity transport equation, and simultaneously solving the Poisson 
problem between the vorticity and stream function, in the region to be inpainted. This 
elegant approach allows one to produce an approximate solution to the image inpaint- 
ing problem by using techniques from computational fluid dynamics (CFD). Recently, 
the three-dimensional (3D) Navier- Stokes- Voight (NSV) model of viscoelastic fluid, was 
suggested by Cao, et. al. as an inviscid regularization to the 3D Navier-Stokes equations. 
We give some background on the NSV mathematical model, describe why it is a good 
candidate sub-grid- scale turbulence model, and propose this model as an alternative for 
image inpainting. We describe an implementation of inpainting use the NSV model, and 
present numerical results comparing the resulting images when using the NSE and NSV 
for inpainting. Our results show that the NSV model allows for a larger time step to 
converge to the steady state solution, yielding a more efficient numerical process when 
automating the inpainting process. We compare quality of the resulting images using 
subjective measure (human evaluation) and objected measure (by calculating the peak 
signal-to-noise ratio (PSNR), also known as peak signal-to-reconstructed measure). We 
also present some new theoretical results based on energy methods comparing the suf- 
ficient conditions for stability of the discretization scheme for the two model equations. 
These theoretical and numerical studies shed some light on what can be expected from 
this category of approach when automating the inpainting problem. 

Contents 



1 . Introduction 2 

2. Image Inpainting Using Fluid Models 3 

2. L Inpainting Using the Navier-Stokes Equations 4 

2.2. Alpha Models and the Navier-Stokes-Voight (NSV) Equations 5 

2.3 . The Alpha Model as Sub-Grid-Scale Turbulence Model 7 

2.4. Navier-Stokes-Voight for Image Inpainting 7 

3. Numerical Comparison NSE and NSV for Image Inpainting 8 

3 . L Stability Behavior of NSE and NSV for Inpainting 8 
3.2. Comparing the Efficiency of NSE and NSV for Inpainting 10 

4. Some Supporting Theoretical Results 12 

4.1. Uniqueness of Steady State Solutions for Boundary Driven Flows 14 

4.2. Stability Analysis of the Scheme based on 2D NSE 15 

4.3. Stability Analysis of the Scheme based on 2D NSV 19 

4.4. StabiHty Analysis of a Semi-ImpHcit Scheme based on 2D NSE 21 

5. Summary 23 

6. Acknowledgments 24 
References 24 



Date: December 15, 2009. 

Key words and phrases. Navier-Stokes-Voight, sub-grid scale turbulence model, fluid mechanics, 
image inpainting. 

MH was supported in part by NSE Awards 0715146 and 0915220. 
ME and EL were supported in part by NSE Award 0715146. 

1 



2 



M.A. EBRAHIMI, M. HOLST, AND E. LUNASIN 



1. Introduction 

Image inpainting (inpainting for short) is the process of correcting a damaged im- 
age by fiUing in the missing or altered data of an image with a better suited data for 
that region. The idea is to fill in the damaged part of an image using the information 
from surrounding areas. The goal of researchers in this area is to develop algorithms for 
automatic digital inpainting which mimics the basic manual techniques used by a profes- 
sional restorer. In 2001, Bertalmio, et. al built a method based on an analogy between 
image intensity and the stream function in a two-dimensional (2D) incompressible fluid. 
The solution to the inpainting problem is then obtained by numerically approximating 
the steady state solution of the 2D Navier-Stokes vorticity transport equation, for some 
small viscosity, and simultaneously solving the Poisson problem between the vorticity 
and stream function in the region to be inpainted. This approach enables automation of 
the inpainting process by which inpainting is done using techniques from computational 
fluid dynamics (CFD). However, difficulties which arise in CFD are also inherited. 

For inpainting, the viscosity in the fluid model should be as small as possible to pre- 
serve edges. However, CFD simulation of high Reynolds number flows (flows with very 
small viscosity) requires very fine mesh in order to resolve the wide range of scales of 
motion contributing to the dynamics of the flow. Sub-grid scale modeling is an alternative 
that reduces the computational requirements when simulating turbulent flows. Recently, 
the three-dimensional (3D) Navier-Stokes- Voight (NSV) model of viscoelastic fluid, 

-a^^ut + ut- v^u + {u • + Vp = f, 

with initial condition u{x,0) = u'^^{x) was suggested by Cao, et. al. as an inviscid 
regularization to the 3D Navier-Stokes equations (NSE), where the length-scale a is 
considered as the regularizing parameter, u is the velocity of the fluid with viscosity 
u > 0, p is the pressure and / is the body force. Note that when a = 0, we re- 
cover the Navier-Stokes equations of motion. The system (1.1) was first introduced in 
1973 by Oskolkov (see [30, 31]) as a model of a motion of linear, viscoelastic fluid. 
In that setting, a is thought of as a length-scale parameter characterizing the elasticity 
of the fluid. The 3D NSV model is shown to be globally well-posed [30, 31] and has 
a finite-dimensional global attractor [21], making it an attractive sub-grid scale turbu- 
lence model for numerical simulation. In the presence of physical boundaries, the above 
regularization of the NSE is different in nature from other alpha regularization models 
in [7, 8, 9, 10, 11, 13, 20, 24, 29] (see also Section 2.2), because it does not require 
additional boundary conditions. 

In this paper, we investigate a new approach which arises by combining the recent 
technique in [4], which uses ideas from classical fluid dynamics to propagate isophote 
lines, and recent results in [8, 22, 21], which studies the NSV model of viscoelastic fluid 
as a candidate sub-grid scale turbulence model for purposes of numerical simulation. 
Other PDEs have been proposed recently for example in [6, 34] which are possibly con- 
sidered to be more efficient and perhaps easier to implement. Of particular interest to 
us in this area is to explore different sub-grid scale turbulent models applied to image 
inpainting. For the reasons outlined above, we have chosen this particular turbulence 
model to study in the context of inpainting. Using this new model, we will study the 
effect of the regularization parameter a (which one can think of as the filter width) on 
quality and efficiency of inpainting automation. As part of our investigation of 2D NSV 
for inpainting, we examine the differences between the 2D NSV model and the 2D NSE 
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for inpainting. We look at semi-implicit forward-time upwind method for both NS V and 
NSE and compare their stability and efficiency. We will refer to these numerical meth- 
ods by their corresponding mathematical model: NSV and NSE numerical model. Our 
numerical results show the NSV model, in comparison to NSE, yields a more stable solu- 
tion to the inpainting process. That is, the NSV can be computed with larger time-steps, 
reducing the computational expense in the automated inpainting procedure. However, 
we also study the efficiency of the calculation of the model equations as well as the qual- 
ity of the resulting images. We hope that these theoretical and numerical studies shed 
some light on what can be expected from this category of approach when automating the 
inpainting problem. 

This paper is organized as follows. In Section 2 we review the work of Bertalmio et. 
al in [4] on exploiting an analogy between image intensity and the stream function in 2D 
incompressible fluid. In Section 2.2 we give some background on the NSV mathematical 
model, discuss why it is a good candidate sub-grid-scale turbulence model, and argue that 
it makes for a plausible alternative model for inpainting. In Section 3 we describe our 
implementation, and then present our numerical results, comparing the resulting images 
when using the NSE and NSV for inpainting. The results show the NSV model allows for 
larger time steps to converge to the steady state solution yielding a more efficient numeri- 
cal process when automating the inpainting process. We compare quality of the resulting 
images using subjective measure (human evaluation) and objected measure (by calculat- 
ing the peak signal-to-noise ratio (PSNR), also known as peak signal-to-reconstructed 
measure). We also give approximate operation counts needed by the two models to con- 
verge to steady state solution for some fixed tolerance. In Section 4 we present some 
supporting theoretical results. In Section 4.1, we summarize some existing results on the 
dependence of uniqueness of the solution to the inpainting problem on the image at the 
boundary, viscosity and on the size of the inpainting region. In Sections 4.2, 4.3, and 
4.4, we establish some new results comparing the NSE and NSV in terms of stability 
conditions. We describe the discretization under consideration, and following [33], de- 
rive sufficient conditions for stability based on energy methods, establishing results that 
support our numerical results. In Section 5 we summarize our results and outline some 
future directions for this work. 



2. Image Inpainting Using Fluid Models 

In this section we present a summary of the approach in [4] for automating the inpaint- 
ing process motivated by ideas from classical fluid dynamics. The idea is to propagate 
isophote lines from the exterior into the region to be inpainted, which we denote as Vt, 
using the 2D NSE for fluid dynamics. Throughout the paper, we denote the digital gray- 
scale image by /, an m x n matrix with gray-scale value to 255 at each pixel, and D 
be the set of points (x, y) where / is defined. The value represents black and the value 
255 represents white. The values in between are different gray levels between black and 
white. 

To solve the inpainting problem, a common technique for restorers (see e.g., [5]) is to 
extend edges from the boundary of Vt, filling in the intra-region with the correct color 
gradient. For example, in Figure 1, the direction of the isophotes (level lines of equal 
color gradients) determines where the smoothness should propagate. To see how we can 
automate this technique, we first introduce some basic mathematical concepts. Mathe- 
matically, the direction of isophotes (level curves of equal gray-levels) can be represented 
as V^/, which indicates the direction of zero change, and the smoothness of the image. 
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Figure 1 . This image shows the direction of the isophotes and where the 
smoothness should propagate. 

can be represented by A/, where A is the usual Laplacian operator (see [4] and refer- 
ences therein). 

2.1. Inpainting Using the Navier-Stokes Equations. In [5], Bertalmio, et, al pro- 
posed that the solution /* can be approximated with the steady solution to the PDE of 
the form 

/, = V^/ . VA/ + vV . (^(1 V/|)V/), (2.1) 
for small > 0, where the anisotropic diffusion is added to preserve the edges. We will 
list below a few diffusivity functions g that are used in the literature. To be more precise, 
the main goal is to find the solution /* such that the level curves of A/* almost parallel 
to V^/*, that is, 

V^r • VA/* 0. (2.2) 

Bertalmio et, al [4] exploited an analogy between the image of intensity function / and 
the stream function in a 2D incompressible fluid. To see this, we recall the vorticity- 
stream formulation of the 2D NSE, 

duo 

— + v 'Vuj = uAuj. (2.3) 
at 

Here v = is the velocity, where is the stream function and uu = \/ x v is the 

vorticity. If the viscosity u is zero, the steady state solution for the stream- function in 
2D satisfies 

V^^^ • VA^^ = 0. (2.4) 

The similarity between (2.2) and (2.4) allows one to develop methods for the inpaint- 
ing problem using techniques from fluid dynamics. For the image inpainting problem, 
instead of simulating (2.3), we compute the following numerically: 

^ + vVu; = iyV • {g{\Vu;\)Vu;), (2.5) 

where g accounts for the anisotropic diffusion (edge preserving diffusion) to sharpen the 
image. At each time step, we solve the Poisson equation: 

AI = uj, I\dn = Io. (2.6) 

where the boundary values Iq are derived from the values of I in D — Q. 

We recall that other PDEs have been proposed recently (cf. [6, 34]) which have been 
shown to more efficient and perhaps easier to implement. Here, our main interest is to 
explore different sub-grid scale turbulent models applied to image inpainting. The idea 
is to test different sub-grid scale turbulence models instead of simulating the NSE (or the 
equation in (2.5)) for purposes of finding the solution to the image inpainting problem 
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for reduced computational requirements. Modifying the function g appropriately in (2.5) 
can also add to the accuracy of preserving the edges and hence give a more accurate 
image inpainting. In (2.5) we noted that for the image inpainting, the dissipation term in 
the NSE was modified to accommodate anisotropic diffusion. If g = 1, wt recover the 
usual NSE with isotropic diffusion. There has been extensive analysis of various types of 
anisotropic filtering, see for example [35]. In our numerical simulation of equation (2.5) 
we have used several different diffusivity functions, namely, 



1 + 



g[s) = exp 



1 + 



k^ 



where A; is a predefined diffusion parameter. For the particular test cases performed, 
we observed no significant difference in the numerical solution to the image inpainting 
problem. 



Original image with noise 



Recovered image witli NSE: v=2, dt = .0001 
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Figure 2. This is an example of image inpainting resulting from the steady 
state solution of the Navier-Stokes equations (with anisotropic diffusion to pre- 
serve edges) with viscosity v — 2. The time-step dt was set to .0001 to guarantee 
convergence of the numerical solution. 

Just as an illustration of the idea, we give a simple numerical experiment. In Fig- 
ure 2.1a, we took the photo of Alexander Ebrahimi with a noise mask as a test case. 
We run the Navier-Stokes equations (NSE) with anisotropic diffusion until its steady 
state [4], and recovered the picture in Figure 2.1b. The iterative inpainting process writ- 
ten in MATLAB took 24 iterations with a tolerance of 0.0001, in about 1.84 seconds on 
a laptop computer with a Intel(R) 1.60 GHz CPU. The grid for the inpainting region is 
49 X 59 pixels. 

2.2. Alpha Models and the Navier-Stokes-Voight (NSV) Equations. The NSV equa- 
tions (1.1) were suggested as a regularization model for the 3D NSE, where the length- 
scale a is considered as the regularizing parameter. The system (1.1) was first introduced 
in 1973 by Oskolkov (see [30, 31]) as a model of a motion of linear, viscoelastic fluid. 
In that setting, a is thought of as a length-scale parameter characterizing the elasticity 
of the fluid. As noted in [22, 21], the addition of the term —a'^Aut regularizes the 3D 
NSE which makes it globally well-posed [8, 30] and it changes the parabolic charac- 
ter of the original Navier-Stokes equations where in this case one does not observe an 
immediate smoothing of the solutions as usually expected in parabolic PDEs. Instead, 
the equations behave like a damped hyperbolic system. Despite the damped hyperbolic 
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behavior, it was shown in [22] that the solutions to the 3D NSV equations lying on the 
global attractor posses a dissipation range. This property supports the claim that indeed, 
the NSV equations can be used as a sub-grid scale turbulence model. This type of invis- 
cid regularization (that is, a regularization technique without introducing extra viscous 
or hyperviscous terms) has been used for 2D surface quasi-geostrophic (SQG) model 
([23]), see also [3] for the Birkhoff-Rott equation, induced by the 2D Euler-a equations 
for vortex sheet dynamics and [25] for the 3D Magnetohydrodynamics (MHD) equations. 

There is an interesting literature behind the rediscovery of the NSV equation as a 
turbulence model. It can be traced back from the early study of 3D Navier-Stokes-a 
(NS-a) turbulence model in 1998 (also known as the viscous Camassa-Holm equations 
(VCHE) and Lagrangian averaged Navier-Stokes-a (LANS-a) model, which can be writ- 
ten as [15, 16, 19, 28] 

dtv — v/S.v — u X V X V = —Vp + /, 

\/ ' u = \/ ' V = 0, (2.7) 

V = {I — a'^A)u^ 

with u{x, 0) = u'^^{x). The parameter a can be viewed as the length scale associated 
with filter width smoothing v to obtain u, with filter associated with the Green's function 
(Bessel potential) of the Helmholtz operator (/ — a'^A). The system is supplemented 
with periodic boundary conditions in a box [0, L]^. 

The inviscid and unforced version of the 3D NS-a was introduced in [19] based on 
the Hamilton variational principle subject to the incompressibility constraint div ^ = 0. 
By adding the viscous term —uAv and the forcing / in an ad hoc fashion, the authors 
in [9, 10, 11] and [16] obtain the NS-a system which they named, at the time, the vis- 
cous Camassa-Holm equations (VCHE), also known as the Lagrangian averaged Navier- 
Stokes-a model (LANS-a). In [9, 10, 11] it was found that steady state solutions of the 
3D NS-a model compared well with averaged experimental data from turbulent flows 
in channels and pipes for large Reynolds numbers. This led researchers [9, 10, 11] to 
suggest that the NS-a model be used as a closure model for the Reynolds averaged equa- 
tions. Since then, an entire family of 'a'- models has been found which provide similar 
successful comparison with empirical data - among these are the Clark-a model [7], 
the Leray-a model [13], the modified Leray-a model [20] and the simplified Bardina 
model [8, 24] (see also [29] for a family of similar models). We focus our attention on 
the simplified Bardina model: 

dfV — uAv + {u • V)u = —Vp + /, 

V 'U = V 'V = (2.8) 

V = u — a^Au^ 

with initial condition u{x, 0) = u^^{x). The equation above was introduced and studied 
in [24] supplemented with periodic boundary conditions. Notice that consistent with all 
the other alpha models, the above system is the Navier-Stokes system of equations when 
a = 0, i.e. u = V. In [8], the viscous and inviscid simplified Bardina models were 
shown to be globally well-posed. It was also shown that the viscous simplified Bardina 
model has a finite dimensional global attractor. In [8] it was observed that the inviscid 
simplified Bardina model, is equivalent to the following modification of the 3D Euler 
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equations 



a^A— + — + {u-V)u + Vp = f, 

V •u = 0, 



(2.9) 



with initial condition u{x,0) = u^^. In particular, it is equal to the Euler equations when 
a = 0. Following this observation, Cao, et. al [8] proposed the inviscid simplified 
Bardina model as regularization of the 3D Euler equations that could be used for simu- 
lations of 3D inviscid flows. Inspired by the above model, Cao, et, al then proposed the 
following regularization of the 3D Navier-Stokes equations 



with initial condition u{x, 0) = and subject to either periodic boundary condition or 
the no-slip Dirichlet boundary condition u\qq^ = Q. \n the presence of physical bound- 
aries the above regularization (2.10) of the Navier-Stokes equations, is different in nature 
from any of the other alpha regularization models, because it does not require any addi- 
tional boundary conditions. 

This newest addition to the family of 'a' models was later on discovered to have 
already existed in the literature known as the Navier-Stokes Voight equations but as a 
model for viscoelastic fluids [30, 31]. As mentioned earlier, the a in that setting repre- 
sents the elasticity of the fluid. 

2.3. The Alpha Model as Sub-Grid-Scale Turbulence Model. In addition to the re- 
markable match of explicit analytical steady state solutions of the alpha models to the 
experimental data in channels and pipes, the validity of the first alpha model, namely the 
NS-Qf model, as a sub-grid scale turbulence model was also tested numerically in [12, 28]. 
In the numerical simulation of the 3D NS-a model, the authors of [12, 17, 18, 28] showed 
that the large scale (to be more specific, those scales of motion bigger than the length 
scale a) features of a turbulent flow is captured. For scales of motion smaller than the 
length scale a, the energy spectra decays faster in comparison to that of NSE. This nu- 
merical observation has been justified analytically in [15]. In direct numerical simulation, 
the fast decay of the energy spectra for scales of motion smaller than the supplied filter 
length represents reduced grid requirements in simulating a flow. The numerical study 
of [12] gives the same results, which also hold for the Leray-a model in [13, 17]. 

In [26] it was observed that the scaling exponent of the energy spectrum of the 2D 
Navier-Stokes-a model (NS-a), for wave numbers k such that ka :» 1, is k~^ . A pos- 
teriori, it was observed that this scaling corresponding to that predicted by assuming 
that the dynamics for fca :» 1 was governed by the characteristic time scale for flux of 
the conserved enstrophy. This observation led researchers [26] to speculate that (in gen- 
eral) the unknown scaling exponent for any a-model may be predicted by the dynamical 
time scales for the dominant conserved quantity for that model in the regime ka ^ 1. 
This speculation is verified to be correct in [27], where numerical simulations of the 2D 
Leray-a model were presented. 

2.4. Navier-Stokes-Voight for Image Inpainting. The main difference between NSV 
and other alpha models is that it needs no additional boundary conditions in the presence 
of physical boundaries. This makes NSV a natural alternative to NSE for inpainting. 
In order to solve the inpainting problem we need to compute the solution to (2.4). We 
approximate it with the steady state solutions of (2.5) with viscosity z/ > 0. As noted 




(2.10) 



V •u = 
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in [4] the presence of viscosity is needed to have a unique steady-state solution and its 
stability depends on how big or small is the viscosity. It is well-known that for very high 
Reynolds number flows (ie very small viscosity u), direct numerical simulation of the 
NSE, requires computational resources which cannot be accessed easily. For purposes 
of direct numerical simulations, the NSV equations were proposed as a sub-grid scale 
turbulence model. Here we would like to investigate the effects of this regularized equa- 
tions to image inpainting. Notice that the steady state solution to the NSV equations in 
(1.1) matches the steady state solution to the NSE. We expect that by using the NSV, 
the convergence to the steady state solution will be at a much faster rate reducing the 
computational cost. 



3. Numerical Comparison NSE and NSV for Image Inpainting 
We simulate the inviscid 2D NSV with anisotropic diffusion (artificial viscosity) 

- c^'^A^ + ^+u-Vu; = uV • {gUVuDVu), (3.1) 

where, uu = V x u. Notice that when a = 0, we recover (2.5). Using a forward time 
up-wind finite-difference scheme [2], we solve for ^^^^^^ in the discretized equation: 

(1 - «^A)<+i - udt {dAgco:^') + dyigu^^')) = (1 - a^A^ 



+ dt 



(3.2) 



Our numerical experiments can be summarized into three categories: test for stability, 
test for efficiency and test for quality. In section 3.1, we present some test cases showing 
that for a given time stepping size, the gray-level blows up when the inpainting is done 
using NSE while the inpainting using NSV produced a stable solution. We give theoret- 
ical arguments in the appendix which in some sense support these numerical results. It 
is worthwhile to mention that using an explicit numerical scheme for both the 2D NSE 
and 2D NSV equations, one can see a nice advantage of using NSV instead of the NSE 
in automating the inpainting problem in terms of CFL condition when we for simplicity 
ignore the nonlinear term in the governing equations. In particular, the usual stiffness 
of the NSE by discretizing the linear part explicitly is no longer present for NSV. In the 
Appendix, we present rigorous argument for the stability condition when the nonlinear 
term is taken into consideration. In section 3.2 we present some numerical studies using 
NSE and NSV for different values of a. We look at the effect of the parameter a on 
the quality of the resulting images and estimate the number of floating point operations 
(FLOPS) needed to converge to steady state. We perform this numerical experiment for 
two different time- steps. The quality of the resulting image is measured using PSNR 
which will be defined in the next section. 

3.1. Stability Behavior of NSE and NSV for Inpainting. In this section we will present 
two test cases comparing the NSE and NSV both with anisotropic diffusion. The results 
presented here suggests that for some fixed specified time-stepping size dt, the NSV 
produced a stable solution in the image inpainting iteration process while the NSE with 
anisotropic diffusion provided an unstable solution (gray-level blows up). A quick sum- 
mary of results is provided in Table 1 . 

For each test cases, we fix the viscosity tolerance tol, and the inpainting region 
In Figure 3a, the inpainting region was computed in a grid (in pixels) of 10 x 10. For 
(it = 0.1 and u = 2, the NSE did not converge to the steady state solution due to large 
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Table 1 . Comparison between NSE( a = 0) andNSV. v - viscosity coefficient, 
dt- size of time step, Vt (in pixels) = size of the inpainting region. 
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time-stepping, as shown in Figure 3b. On the other hand, for the same dt = 0.1 and 
viscosity = 2, the steady state solution to NSV with a = 0.5 gave a reasonable image 
inpainting as shown in Figure 3c. In Figure 3d, we show the converged steady state 
solution of NSE for a smaller dt = 0.001. Using a subjective measure. Figures 3c and 
3d are comparable in quality but Figure 3d required a larger time-step to converge to the 
steady state solution. 
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Figure 3 . A comparison between the NSE andNSV. Figure a: Original image 
I with the inpainting region. Figure 3b: For step size dt = 0.1 the NSE with 
anisotropic diffusion does not converge to its steady state solution. Figure 3c: 
On the other hand the NSV with anisotropic diffusion does converge for a — 0.5 
and dt — 0.1. Figure d: For a smaller step size dt — .001, the NSE with 
anisotropic diffusion does converge. 
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[ht] In Figure 4a, we choose a slightly different size of the inpainting region computed 
in a grid (in pixels) of 64 x 12. For dt = 0.1 and ly = 2, the NSE did not converge to 
the steady state solution due to large time-stepping, as shown in Figure 4b. Similar to 
the first example, for the same dt = 0.1 and viscosity = 2, the steady state solution to 
the NSV model, with a = 0.9, gave a reasonable result to the image inpainting problem 
as shown in Figure 4c. In Figure 4d, we show the converged steady state solution of 
NSE for a smaller dt = 0.01. Figures 4c and 4d are comparable in quality but Figure 4d 
required a larger time-step to converge to the steady state solution. 



Original image witli noise No convergence witli NSE: a = 0, v=2, dt=0.1 




(c) (d) 

Figure 4. A comparison between the NSE and NSV. Figure a: Original image 
I with the inpainting region. Figure4b: For step size dt — 0.1 the NSE with 
anisotropic diffusion does not converge to its steady state solution. Figure 4c: 
On the other hand the NSV with anisotropic diffusion does converge for a = 0.9 
and dt — 0.1. Figure 4d: For a smaller step size dt — .001, the NSE with 
anisotropic diffusion does converge. 



3.2. Comparing the Efficiency of NSE and NSV for Inpainting. The NSV converges 
to its steady state solution using a larger time- step or fewer number of iterations. How- 
ever, it is not clear whether it is more efficient than the NSE because of the extra com- 
putational cost, for the a term, for each iteration. In addition, we also need to compare 
the quality of the resulting images. We do a FLOP counting for the two model equations 
until it reached a steady state solution by using the Lightspeed MATLAB toolbox. We 
approximated the FLOP by taking only in consideration the cost of matrix inversions. 
We use the FLOPJnv function which returns the number of FLOP necessary to invert an 
n X n matrix. Note that this function returns the minimal number of FLOP for matrix 
inversion, as though the best possible algorithm was used, no matter which method we 
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are actually using. This should not be an issue for we use the same matrix inversion 
technique when running the two model equations. Given that Q is N x M, take 
n = max(A^, M). We then normalize the FLOP count by dividing it by the number of 
pixels in That is, the FLOP count is in units of number of FLOP per pixel. In addition, 
we also compute the PSNR of the resulting images to give some measure of comparison 
for the quality of the resulting images in addition to subjective measure. Let P{i, j) be 
the original image that contains by M pixels and the reconstructed image. The 

pixel values range between black (0) and white (255). The PSNR in decibels (dB) are 
computed as follows: 



PSNR = 20 logio f ) . where RMSE 



Comparison between two PSNR values for different reconstructed image gives one mea- 

TABLE 2. Comparison between NSE( a = 0) andNSV. v - viscosity coefficient, 
dt- size of time step, FLOP count = FLOP count/(N^M), PSNR = Peak signal- 
to-noise ratio. 



FLOPS 


a 


dt = 0.001 


dt = 0.0001 







1.2375e4 


9.0000e3 




1/3 


6.3753e3 


5.6253e3 




2/3 


4.1252e3 


3.7502e3 




1 


3.7502e3 


3.3751e3 




4/3 


3.3751e3 


3.7501e3 



sure of quality. Reconstructed images with higher PSNR are considered better. (How- 
ever, as frequently mentioned in the literature, PSNR may not equate with human percep- 
tion; we will view PSNR as a reasonable metric here.) In any case, we now describe of 
our results based on observations in Table 2 and Figure 5. In this numerical experiment, 
we fix the value of u = 2. 

(1) Comparing NSE {a = 0) and NSV with a = 1/3 for both time steps dt = 0.001 
and = 0.0001 in Table 5, we notice the number of FLOPS needed by NSV to 
converge to steady state has been reduced to almost half of the FLOPS required 
by the NSE to converge to its steady state solution. 

(2) In Figure 5a, for smaller dt = 0.001, the PSNR of NSV (a = 1/2) is 45 dB and 
is 1 point higher than that of NSE. In the case when dt = 0.0001, (Figure 5b) the 
PSNR of NSE is 46.5 dB while the NSV for a = 1 /3 has a PSNR value of 46. 

(3) We also notice that increasing the time step from dt = 0.0001 to dt = 0.001 for 
the NSE changes the quality of the picture dramatically under subjective measure. 
In Figure 5, the PSNR for NSE is reduced from 46.5 dB to 44 dB when dt is 
increased from 0.0001 to 0.001. In the case of NSV for a = 1/3, the change in 
quality of the picture under subjective measure is unnoticeable. In particular, the 
PSNR is changed from 46 dB to 45 dB as the dt is increased. 

In summary, one can show that for some value of a > 0, NSV gives an inpainting 
which is comparable to NSE but requiring less resources. It is then natural to ask if 
one can determine the value of a a priori which will yield the smallest FLOP count 
with maximum PSNR. Our preliminary studies suggest that choice of a may be image 
dependent. For this reason, one may prefer the NSE to avoid finding the optimal a. This 
suggests the development of schemes to adaptively determine optimized a. 
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a. NSE (v=2) 

b. NSV(a=1/3,v=2) 
C. NSV (a=2/3,v=2) 

d. NSV(a=1,v=2) 

e. NSV (a=4/3,v=2) 

f. NSV (a=5/3,v=2) 

g. NSV (a=62,v=2) 



10 15 20 

no. of frames (iterations) 



(a) 




a. NSE (v=2) 

b. NSV(a=1/3,v=2) 

c. NSV (a=2/3,v=2) 

d. NSV(a=1,v=2) 

e. NSV (a=4/3,v=2) 

f. NSV (a=5/3,v=2) 

g. NSV (a=62,v=2) 



no. of frames (iterations) 



(b) 



Figure 5 . PSNR o/NSE vs NSV (for various values of a). When dt = 0.001, 
the PSNR of NSV (a=l/3) is higher than the NSE and requires only about half of 
the number of FLOPS needed for the NSE to converge to its steady state solution. 




4. Some Supporting Theoretical Results 

In this section we summarize some existing results, and then estabhsh some new re- 
sults that support the numerical results in the previous section. To this end, let Vt = 
[0, 27rL]^. The NSE of viscous incompressible flows, subject to periodic boundary con- 
dition on domain Vt, is written in the form: 

d+u — uAu + (u • V)u = — Vp + f, 

Y7 n (4.1) 

v ■u = 0, 
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with initial condition u{x,0) = u'^^{x), where u represents the unknown fluid veloc- 
ity, p is the unknown pressure scalar, u > is the constant kinematic viscosity. The 
given forcing function / is assumed here to be time independent and with mean zero: 
f{x)dx = 0. The initial velocity u^^ is also assumed to have zero mean, hence also 
u. Below we use will use standard notation in the context of the mathematical theory of 
Navier-Stokes equations (NSE) (see, e.g., [14, 32, 33]). In particular. 



(1) We denote by W and the usual Lebesgue and Sobolev spaces, respectively. 
And we denote by | • | and (•, •) the L^— norm and L^— inner product, respectively. 

(2) Let be the set of all vector trigonometric polynomials with periodic domain Q.. 
We then set 

V = |(/) G : V • = and j (j){x) rfx = o| . 

We set H and V to be the closures of V in and H^, respectively. We note by 
Rellich lemma (see, e.g., [1]) we have the V is compactly embedded in H. 

(3) We denote by Per i7 the Helmholtz-Leray orthogonal projection operator, 
and hy A = —Pa^ the Stokes operator subject to periodic boundary condition 
with domain D{A) = n V. We note that in the space-periodic case, 

Au = -P^Au = -Au, for all u G D{A), 

with yl"^ self-adjoint positive definite and compact from H into H (cf. [14, 33]). 

Denote < L"^ = Ai < A2 < the eigenvalues of A, repeated according 

to their multiplicities. 

(4) We recall the following two-dimensional Ladyzhenskaya inequality: 

II0IU4 < c\m%'\m]il for every e H^Q). (4.2) 

Hereafter c will denote a generic dimensionless constant. 

(5) For wi,W2 G V, we define the bilinear form 

B{wi,W2) = Pa{{wi-V)w2). (4.3) 

(6) By the Sobolev inequalities and compactness theorems, in two dimensions (or 
any dimensions less than 4) we can define on a trilinear continuous form b by 
setting 

b{u, V, w) = {B{u, v),w). (4.4) 

\iu,v then 

h{u,v,v) = 0. (4.5) 
A special case we will need to establish for stability of 2D NSV is: 

b{u,u,Au) = 0, for all ^ G D{A). (4.6) 

We finish by mentioning some useful inequalities for semi-discretizations. Let n be 
the spatial dimension. The following are easily established (cf. [32, 33]): 

\^h\\l = ^ / \^ih - Uihlx-^ \ \^ dx 




(4.7) 

<4| > 1 M = s{hr\u^\' 
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\AhUh\^ = ^ ^ 1^ J \uih (^x + hj^ + Uih (^x - hj^ - 2uih{x)\^ dx 



(4.8) 



4.1. Uniqueness of Steady State Solutions for Boundary Driven Flows. The results 
in [4] is obtained by requiring the user to tune the parameters and related data in the 
inpainting region to suit the particular problem at hand. In [2] while inpainting various 
sample images, with similar inpainting region, viscosity u and 5t, it was found that cer- 
tain set of parameters produced stable solutions in some images and unstable solutions 
(gray-level blows up) in others. They have noted that certain characteristics of / near 
dQ has some effect on the maximum allowable stable choice of 5t. In this section we 
will present analytical arguments on the dependence of the solution on the image at the 
boundary, size of the inpainting region and viscosity. We give some hypothesis on how 
the related data affects the convergence of the numerical solution. Note that the steady 
state solution for the NS V is exactly equal to the steady state solution of NSE. The main 
goal for this study is to determine the relationship between the viscosity, the image at the 
boundary and the size of the inpainting region. For example, we would like to determine 
for which size of the inpainting region and norm of / on the boundary, do we get a unique 
steady state solution. 

In [4], for the Navier-Stokes based inpainting, a discussion on the uniqueness of steady 
state solution and its relevance to inpainting was presented. It was expected that Navier- 
Stokes based inpainting may inherit some of the stability and uniqueness issues known 
for incompressible fluids, although the effect of anisotropic diffusion is still unclear. The 
dependence of uniqueness in the viscosity of the fluid is discussed in [4]. In this section, 
we present some rigorous arguments following the work in [32, 33]), modified slightly to 
interpret it in the context of image inpainting. In this section we show the dependence of 
the uniqueness of steady solution on the viscosity, on the image at the boundary, and on 
the size of the inpainting region. We start here by recaUing some notation. The notation 
used here are similar to those used in Section 2.2. Let us denote by a bounded domain 
of of class which is filled with an incompressible viscous fluid. 

For the particular application of NSE and NS V in image inpainting, we supplement it 
with Dirichlet boundary condition u = (f) on d^, in which (j) is independent of time. We 
consider here the non-homogeneous steady state Navier-Stokes problem which coincides 
with the steady state Navier-Stokes-Voight problem. Find u and p such that 

- uAu + {u • V)u + Vp = 0, in (4.9) 

div2i = 0, inn, (4.10) 

u = (j) on on. (4.11) 

We assume that cp is given as the trace on dQ of a function $, 

^eH^{n), div$ = 0, / $-nrf5 = 0, (4.12) 

where n is the unit outward normal in dQ. The idea is the following: Given the physical 
data (/) defined on d^, we find an extension $ of inside Q satisfying (4.12). Under 
the above hypothesis there exist at least one u e and distribution p onQ satisfying 
(4.9) (see [32, 33]) provided we choose the extension $ G L^{fl) of cj) such that ||$||a is 
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sufficiently small for a > 2 so that 

\b{v,^,v)\ < ^ll^lp, for all ^ G V. (4.13) 

The construction of $ satisfying (4.12) and (4.13) is presented in [33]. Knowing $ and 
knowing uisa solution of (4.9) then letting u = u — equation (4.9) is equivalent to 

- uAu + {u • V)u + {u • V)$ + ($ • V)u + Vp = z/A$ - ($ • V)$, in (4.14) 

div^ = 0, inn, (4.15) 
u = on ai^. (4.16) 

We now state a uniqueness result. 

Theorem 4.1. Suppose that the norm of^ in L^{Q) is sufficiently small so that 

\h{v,^,v)\ < ^\\v\\\ forallv G V, (4.17) 
and V is sufficiently large so that 

z/2>2CAr'/'||/||, (4.18) 

where f = z/A$ — Ai is the smallest eigenvalue of the Stokes operator, and C 

is constant, then (4.9) has a unique solution. 

Proof See [32, 33]. □ 

We can recast the theorem above, in the context of image inpainting, as the dependence 
of the uniqueness of steady solution on the viscosity on the image at the boundary, 
which is related to $ (since the stream function is related to the velocity field), and on 
the size of the inpainting region which is related to A"^/^. 

4.2. Stability Analysis of the Scheme based on 2D NSE. In this section we are con- 
cerned with a discussion on the discretization of the Navier Stokes equations in two 
dimensions, subject to periodic boundary conditions, with basic domain Q = [0, 27rL]^. 
We study here a full discretization of the equations, both in space and time. We start with 
a description of the approximating scheme and then proceed to the study of the stability 
of this scheme. Our study here is based on the energy methods similar as in [33] which 
leads to sufficient conditions for stability. 

We now begin by defining a Galerkin approximation of the separable normed space 
V. For reference we direct the reader to [33]. Let Vh, /i G N, be an increasing sequence 
of finite-dimensional subspaces of V whose union is dense in V. For simplicity, assume 
that 

Vh C L\n), for all /i G N. (4.19) 
The space Vh is therefore equipped with two norms: the norm | • | induced by L'^{Q) 
and its own norm || • Since Vh is finite dimensional then these two norms must be 
equivalent. To be more precise we have with do independent of /i, 

\uh\ < do\\uh\\h^ for all t^/, G 14, (4.20) 

\\uh\\h < S{h)\uh\, foralluheVh. (4.21) 

Similarly, let D{A)h, /i G N, be an increasing sequence of finite-dimensional subspaces 
of D{A) whose union is dense in D{A). For simplicity, assume that 

D{A)h cVhC L^{n), for all /i G N. (4.22) 

The space D{A)h is therefore equipped with two norms: the norm || • \\h induced by Vh 
and its own norm \Ah-\. Since D{A)h is finite dimensional normed space then these two 



(4.26) 
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norms must be equivalent. To be more precise we have with d2 independent of h, 

\\uh\\h < d2\AhUh\, for all Uh e D{A)h, (4.23) 
\AhUh\ < cS{h)\\uh\\h. for ^ill UheD{A)h. (4.24) 

The constant S{h), which depends on h is sometimes called the stability constant since 
it plays a major important role in obtaining necessary conditions on the stability of nu- 
merical approximations. Usually S'(/i)^oc, as/i^O. 

Let there be given a trilinear continuous form on Vh, say Vh.^h) which satisfies 

the following: 

(1) For all Uh.Vh G Vh, both of the following hold: 

hh{uh,Vh,Vh) = 0, (4.25) 

\bh{uh,Uh,Vh)\ < < diS^{h)\uh\\\uh\\h\vh\ 

< Si{h)\uh\\\uh\\h\vh\, 
where at least, 

Si{h) < diS\h). (4.27) 

(2) FovMuh,Vh,Wh e Vh, 

\bh{uh,Vh,Wh)\ < diWuhWhWvhWhW'i^hWh- (4.28) 

We divide the interval [0, T] into intervals of equal length k = T/N. We associate 
with k and the function /, the elements /i, . . . , /^: 

-1 pmk 

r = T f{t)dt, m=l,...,iV; reL^m. (4.29) 

J(m-l)k 

We denote by ti° the orthogonal projection of the initial condition uo onto D{A)h in 
L'^{Q). When . . . , are known, is the solution in D{A)h of 

- <-\v,) + v{{u^-\vn))h + 6.K"',«r'>^/^) = Um^vn) (4.30) 
for all Vh e D{A)h. 



Lemma 4.2. We assume that k and h satisfy 

(1) kS^{h) < - 

(2) kS^h) < 1 



-1 e 

(1) kS^{h) < for some 5, < 5 < 1 , 



(3) kSf{h)SHh) < 



where do is as in (4.20) and 

d, = \\uof + dl (^^^^) [ l/(^)r ds, (4.31) 

then, the given by (4.30) remain bounded in the following sense 

\K\\l<d, m = l,...,iV, (4.32) 

kY.\^Hur'?<-^. (4.33) 



N 



Y.\\<-<~'\\l^'^{-^)d^ + ^l \f(')\"ds. (4.34) 
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Proof. We replace by by AhU^~^ in (4.30); due to the identity 

2(a -b,b) = \a\^ - \b\^ - \a - 6|^ (4.35) 

we find 

\K\\l - hrX - \K - + 2kv\Auu^-'\^ = 2k{r, Auu^-') 

<2kd,\r\\A^ur'\ (4.36) 

We would like to majorize \\uf^ - u^'^ \\l in (4.36). Let Vh = Ahuf - AhU^'^ in (4.30). 
This gives 

- 2fc5,«-\ - (4.37) 

+ 2k{r. - <"')) =: /i + /2 + h. 

We successively majorize l\, I2 and /s using (4.21), (4.24), (4.26), and Cauchy-Schwarz 
inequality 

< 2A:z/|A^<-i||A,«-<-i)| (4.38) 

< 2kvS{h)\AhU^-^\\\u^ -u^-^\\h (4.39) 

< |IK-<"i^ + 4A:V52^/i)|A;,ti;^-i|2, (4.40) 

I/2I < 2kS^{h)\uZ'\\\uZ%\Au{u^ - uZ')\ (4.41) 

< 2kS{h)Sr{h)\u^-^\\\u^-^\\4u^u^-% (4.42) 

< u^'Wl + AedoS\h)Sl{h)\uZ'nur'\\l (4.43) 

< JlK-<-i^ + 4/c2d^52(/^)5?(/^)|«--Tl^/^<-T, (4.44) 

I/3I < 2k\r\\An{K-u^-^)\<2kS{h)\r\\\u^-u^-^\\n (4.45) 

< \\K-u^-^\\l + Ak^S^{h)\r\. (4.46) 
Denoting as 6 = 4fc2d252(^)^2(^)|^m-i|2|^^^m-i|2^ j^^^^ ^j^^^ (4 37^, becomes 

\Wh - < Ak^i^^S^h)\Ahu';^-^\^ + e < kp{l - + e. (4.47) 
Going back to (4.36) we have 

\K\\l - \K-X + - 4kdlsl{h)s\h)\u^-'\')\A,u^-'\' 
< k (^^ + iks\h)^ 

2 / l^l^n,.^,2 (4-48) 



'dl + l-S 



''0 



"do 
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Summing up (4.48) for m = 1 to r we get 

r 

KWl + kJ2{^^- 4kdlSl{h)S'{h)\u^-'\') \AhU^-'\' < /i„ (4.49) 



m=l 

where 

cm\2 



Now using condition [iii) in Lemma 4.2, we will prove by the method of induction that 

~2 



^ll^ + ^El^'*^"'!'^^- r = ltoiV. (4.50) 



m=l 

First observe that 



pm\2 



^r<^N = \\<r + kdi {^^^) E 1/ 

To estabhsh the basis for induction (r = 1) we write (4.48) for m = 1 and use {in) in 
Lemma 4.2 to get 

WulWl + M\A,ul? < ||«;||? + ikHlSl(h)S\K)\nlf\AH<? 



kp5. . 2 



2 

Thus equation (4.50) for r = 1 is satisfied. By induction on r, assume that (4.50) holds 
up to the order r — 1. Note that by the recurrence hypothesis 

||<"i^ < yWr-l < yWiv < 4. (4.53) 

Thus by (4.49), we have 



I r 



IWl + kv5Y,\Auu^-'\^ < ii, + Ak^dlSl{h)S\h)\u^-'\^ 

r 

<lir + 4edlSl{h)S^{h)d, E l^/.«rT (4.54) 



m=l 



2 

m=l 

Hence, 

\\K\\l + ^i2\A,ur'\'<l^r. (4.55) 

m=l 
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This gives (4.33). It remains to prove (4.34). From (4.47), applying (n) and (Hi) from 
Lemma 4.2, we get 

IK - < A:'zy'5(/i)|A<"T + ^k^dlSl{h)S\h)\u';^-^\^\AhU^m - 1|' 

+ 4eS\h)\n^ 

< ku{2 - 5)\Ahu';^-^\^ + 4A;|/^|2. 

(4.56) 

Summing it up over all m = 1 to and using (4.33) we find (4.34). □ 



4.3. Stability Analysis of the Scheme based on 2D NSV. The preliminary setup is the 
same as those of 2D NSE in the previous section. When u^, . . . , u^~^, dirt known, u)^ is 
the solution in D{A)h of 

for all VheVh. 

Lemma 4.3. We assume that k and h satisfy 

1 /S 

(1) kS'^{h) < for some 5,Q<5<1, 

(2) kSl{h) < 

= \uo\^ + a^Wuof + (^^ + \f{s)\^ds, (4.58) 

and do is as in (4.20), then, the given by (4.57) remain bounded in the following sense 

KP + tt^lKII^ < 4 m = l,...,7V, (4.59) 

kY.\\<-"\\l^-^^ (4.60) 

m=l 

Proo/ We replace by vh by v^'^ in (4.57); due to (4.20), (4.21),(4.35) and Cauchy- 
Schwarz, we get 

+ «'(IKi-IK-'ll^-IK-<-^llD 

= 2A:(r,A,<-i) (4-62) 
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that is, 



(KP-K-^r)+«MlKi-IK-^llD 

We would like to majorize the term - + a^Hw/T - -"^"^111) (4.63). Let 

z;,, = m;;^ - in (4.57). This gives 

= -2A:j.(«-\<-<-i)), (4.64) 

- 2A;6U<-\ < - + 2A:(r , < - =: A + /a + /s- 

We successively majorize Ii, I2 and I3 using repeatedly (4.21), (4.26), and Cauchy- 
Schwarz inequality and get exactly the estimates as in page 234 of [33]. Therefore (4.64) 
becomes 



1% 



+ 4p52(;j)|^m-l|2||^m-l||2 ^ 4^2|^m|2 

<Mi-<^)IK-i^ 



(4.65) 



Going back to (4.63) we have 



\Uh\ -\Uh 



^,2 ^^■-^^'+am\uni-\K-X) 

+ kius - 4ks!{h)K-'\')\\urX 

<k(^^ + 4k^ |/-|2 (4.66) 
<k(^ + at] (since k < T). 



Summing up (4.65) for m = 1 to r we get 



;r + o?\\^lfn ^kY^ivb- 4kSl{K)\<-'f) \\<-X < f^r, (4.67) 



\u 

m=l 

where 



^l\\l + k(^+4T)j2\r 

^ / m=l 



Now using condition (ii) in Lemma 4.3, we will prove by the method of induction that 

KI' + «'IKII^ + ^ElK"'ll^</^r, r = UoN. (4.68) 

m=l 

First observe that 

^ir<fiN = \ul\' + a^lKlP + M 7 + 4r 5] =: 4. (4.69) 

^ ^ m-1 
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To establish the basis for induction (r = 1) we write (4.66) for m = 1 and use (n) in 
Lemma 4.3 to get 



Thus equation (4.68) for r = 1 is satisfied. By induction on r, assume that (4.68) holds 
up to the order r — 1. Note that by the recurrence hypothesis 

+ «2||^^-i||2 < < < 4. (4.71) 

Thus by (4.67), we have 

r 



m=l 



<fir + ^k^Sl{h)dQ Yl \K~^\\l (4.72) 



ku5 



m=l 



\ ^ 11 .m-l||2 



2 ^ 

171=1 



Hence, 



r\2 , ^2|i .r||2 



+ ^EK"II^^/^- (4.73) 

m=l 

This gives us (4.60). It remains to prove (4.61). From (4.65) and applying condition (i) 
and (n) from Lemma 4.3, we get 

K - <-T + «K - <-X < - s)\\u^-X 

+ 4k'SKh)\ur'\'\K-X + ^k'\n' (4,74) 

<ku (^1-0 \K-x+^kT\n'- 

Summing it up over all m = 1 to and using (4.60) we find (4.61). □ 

4.4. Stability Analysis of a Semi-Implicit Scheme based on 2D NSE. We present 
here general results for stability analysis for the full NSE equations vorticity formula- 
tion (implicit only on the linear part of the operator). The setup is as follows: When 
u^, . . . , u^~^, are known, is the solution in D{A)h of 

^(u';:-u';:-\vh) + Hi<.Vh))h + bhK~\u^-\vh) = {Uvh), (4.75) 
for all VhEVh. 

Lemma 4.4. We assume that k and h satisfy 

(1) kS'^ih) < d', 

(2) ksf{h)S'^{h) < d", 

where d' = and d" =, then, the given by (4.75) remain bounded in the following sense 

\\Uh\\h<d7, m = 0,...,N, 

(4.76) 



1 ' 1 

N N 



m=l 171=1 
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where d-j is some constant depending only on the data d' and d". 



Proof. We let Vh = Ahu"^ in (4.75). Using the identity (4.35), we get 

IKII^ - ll^r'lk + \K- + 2ku\A,u^\' 

= -2kbh {u^-\u^-\ Anu^) + 2k{r, A^v!^) {A.ll) 
■.= h + h. 

We would like bound the terms h and The identity hu ^^h~^) = 

together with (4.20) and (4.26) gives 



< 2kS^{h)S{h)K-'\\\u^-%\\u^ - 

1 

2' 



Hence, 

-2k''s^,ih)s\h)\u^-'\''\K-X < ^\r\\ 

We sum up these inequalities for m = 1 to r, to get 

1 

2 

m- 

2k'si{h)s\h)Y,K-'nu^-'\\i<\ 



m=2 

where, 

kd: 



(4.78) 



and 

I/2I < 2kdo\n\AhuT\ < k f^l/^r + i^lAuTl' ] . (4.79) 



(4.80) 



(4.81) 



A. = KWh = ^ E + 2k'S!{h)S\h)\uimul\\l (4.82) 

171=1 

We assume that 

2kdod2Sl{h)S^{h)XN <^-5, (4.83) 
for some fixed < 5 < vAi this holds then one can show recursively that 

-i r r 

\Wh\\l + 2 E IK - + ^'^ E l^'^^l' ^ r = l,...,N. (4.84) 

m— 1 m=l 

Clearly, letting m = 1 in (4.80) shows that (4.84) is true for r = 1. Let us assume that 
(4.84) is valid up to the order r — 1, we want to show that (4.84) is valid for r. Observe 
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that by the inductive hypothesis < < Aa^. Hence, by the condition (4.83) 

2es!{h)s\h) j2 K-'\\K-'\\l < 2d,es!{h)s\h) k-'\\a,u^-'\' 

m=2 m=2 



< 2dod2k^Sl{h)S\h)\N J2 l^'*^"'!' (4.85) 



m—1 

r 

171=1 

We apply this upper bound into (4.81), we get (4.84) for the integer r. To complete the 
proof it suffices to show that conditions (i) and (n) in Lemma 4.4 ensure the condition 
(4.83). We recall that since \\u^\\ < \\uo\\ for all /i and 

N 



m=l ^0 



(4.86) 



then, 

^ Jo 

< dio + 2eSl{h)S\h)\uo\^\\uo\\^. 
Hence, if kSfS\h) < d\ then 

2kdod2Sl{h)S\h)XN < 2d\dio + 2d'd''\uo\^\\uo\\^) < u - S, (4.87) 
provided d', d" are sufficiently small. □ 



5. Summary 

The NSV model of viscoelastic incompressible fluid has been proposed as a regular- 
ization of the 3D NSE for purposes of direct numerical simulation. In this work, we have 
shown one of the benefits of using the 2D NSV turbulence model for small regularization 
parameter a, instead of the 2D NSE to reduce computational expense when automating 
the inpainting process. To be more precise, one can find a parameter a > in which 
the 2D NSV gives a solution to the image inpainting problem comparable (both using 
subjective and objective measure) to that of the solution of the 2D NSE but only requires 
a time step much larger in comparison to that of 2D NSE. That is, the 2D NSV converge 
to the steady state solution with a much larger time step and hence solves the image in- 
painting problem using less computational resources. In the numerical experiments, we 
found that after accounting for the relative costs of the two methods, the 2D NSV gives 
a solution to the inpainting problem which matches the quality of the image produced by 
when NSE is used but using less resources. 

In future work we would like to investigate other PDEs which can be used instead of 
the 2D NSE and 2D NSV when solving the inpainting process. In particular, we would 
like to use a PDE to solve the inpainting problem without the addition of anisotropic 
diffusion. The dependence of the stability of solutions on certain characteristics of the 
image near the boundary is also of major interest in this topic. We would like to in- 
vestigate the dependence of the uniqueness of steady solution on the viscosity, on the 
image at the boundary, and on the size of the inpainting region. We have presented some 
basic results on the uniqueness of steady state solution of the 2D steady state applied in 



24 



M.A. EBRAHIMI, M. HOLST, AND E. LUNASIN 



the context of image inpainting. We would like to do further numerical experiments to 
verify these hypothesis. 

6. Acknowledgments 

We would like to thank E.S. Titi, D. Reynolds, and Y. Zhou for valuable discussions 
on discretization techniques and other helpful comments on this study. In particular, we 
would like to thank E.S. Titi for showing us the proof of the dependence of the uniqueness 
of the inpainting solution on the viscosity, on the image at the boundary and the size of 
inpainting region. MH was supported in part by NSF Awards 0715146 and 0915220. ME 
and EL were supported in part by NSF Award 0715146. 

References 

[1] R. Adams, Compact imbeddings ofW^'^{VL), in Sobolev Spaces, S. Eilenberg and H. Bass, eds.. 

Academic Press, New York, 1975. 
[2] W. Au AND R. Takei, Image inpainting with the Navier-Stokes equations. Available at Final Report 

APMA 930 SFU, 2002. 

[3] C. Bardos, J. LiNSHiz, AND E. S. TiTl, Global regularity for a Birkhoff-Rott-a approximation of 

the dynamics of vortex sheets of the 2D Euler equations. 2008. 
[4] M. Bertalmio, a. L. Bertozzi, and G. Sapiro, Navier-Stokes, fluid dynamics, and image 

and video inpainting, 2001 IEEE Computer Society Conference on Computer Vision and Pattern 

Recognition (CVPR'Ol), 1 (2001), p. 35. 
[5] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, Image inpainting, International 

Conference on Computer Graphics and Interactive Techniques, (2000), pp. 417-424. 
[6] F. Bornemann and T. Marz, Fast image inpainting based on coherence transport, J. Math, 

Imaging Vis., 28 (2007), pp. 259-278. 
[7] C. Cao, D. Holm, and E. Titi, On the Clark-a model of turbulence: global regularity and 

long-time dynamics. Journal of Turbulence, 6 (2005), pp. 1-11. 
[8] Y. Cao, E. Lunasin, and E. Titi, Global well-posedness of the viscous and inviscid simplified 

Bardina model, Communications in Mathematical Sciences, 4 (2006), pp. 823-848. 
[9] S. Chen, C. Foias, D. Holm, E. Olson, E. Titi, and S. Wynne, Camassa-Holm equations 

as closure model for turbulent channel and pipefiow, Phys. Rev. Lett., 81 (1998), pp. 5338-5341. 

[10] , The Camassa-Holm equations and turbulence, Phys. D, 133 (1999), pp. 49-65. 

[11] , A connection between the Camassa-Holm equations and turbulent flows in channels and pipes, 

Phys. Fluids, 11 (1999), pp. 2343-2353. 
[12] S. Chen, D. Holm, L. Margolin, and R. Zhang, Direct numerical simulation of the Navier- 
Stokes alpha model, Phys. D, 133 (1999), pp. 66-83. 
[13] A. Cheskidov, D. Holm, E. Olson, and E. Titi, On a Leray-a model of turbulence, Royal 

Soc. A, Mathematical, Physical and Engineering Sciences, 461 (2005), pp. 629-649. 
[14] P. CONSTANTIN AND C. FoiAS, Existence and uniqueness theorems, in Navier-Stolces equations, 

J. P. May, R. Zimmer, and S. Block, eds.. The University of Chicago Press, Chicago and London, 

1988. 

[15] C. FoiAS, D. Holm, and E. Titi, The Navier-Stokes-alpha model of fluid turbulence, advances 
in nonlinear mathematics and science, Phys. D, 152/153 (2001), pp. 505-519. 

[16] , The three-dimensional viscous Camassa-Holm equations, and their relation to the Navier- 
Stokes equations and turbulence theory, J. Dynam. Differential Equations, 14 (2002), pp. 1-35. 

[17] B. Geurts and D. Holm, Fluctuation effects on 3d-Lagrangian mean and Eulerian mean fluid 
motion, Phys. D, 133 (1999), pp. 215-269. 

[18] , Regularization modeling for large eddy simulation, Phys. Fluids, 15 (2003), pp. L13-L16. 

[19] D. Holm, J. Marsden, and T. Ratiu, Euler-Poincare models of ideal fluids with nonlinear 
dispersion, Phys. Rev. Lett., 80 (1998), pp. 4173-4176. 

[20] A. ILYIN, E. Lunasin, and E. Titi, A modified-Leray-a subgrid scale model of turbulence, 
Nonlinearity, 19 (2006), pp. 879-897. 

[21] V. Kalantarov and E. S. Titi, Global attractors and estimates of the number of degrees of 
freedom of determining modes for the 3D Navier-Stokes -Voight equations. arXiv.0705.3972vl, 2007. 



THE NAVIER-STOKES-VOIGHT MODEL FOR IMAGE INPAINTING 



25 



[22] V. K. Kalantarov, B. Levant, and E. Titi, Gevrey regularity of the global attractor of the 3D 
Navier-Stokes-Voight equations, J. Nonlinear Sci., (2007). to appear. 

[23] B. Khouider and E. S. Titi, An inviscid regularization for the surface quasi- geostrophic equa- 
tion. Comm. Pure Appl. Math, 61 (2008), pp. 1331-1346. 

[24] W. Layton and R. Lewandowski, On a well-posed turbulence model. Discrete and Continuous 
Dyn. Sys. B, 6 (2006), pp. 111-128. 

[25] J. LiNSHiz AND E. Titi, Analytical study of certain magnetohydrodynamic-alpha models, J. Math. 
Phys., 48 (2007). 

[26] E. LUNASIN, S. KURIEN, M. Taylor, and E. Titi, A study of the Navier-Stokes-a model for 

two-dimensional turbulence. Journal of Turbulence, 8 (2007), pp. 751-778. 
[27] E. LUNASiN, S. KURIEN, AND E. TiTl, Spectral scaling of the leray-a model for two-dimensional 

turbulence, J. Phys. A: Math. Theor., 41 (2008), p. 344014. 
[28] K. MOHSENI, B. KOSOVIC, S. Shkoller, and J. Marsden, Numerical simulations of the La- 

grangian averaged Navier-Stokes equations for homogeneous isotropic turbulence, Phys. Fluids, 15 

(2003), pp. 524-544. 

[29] E. Olson and E. Titi, Viscosity versus vorticity stretching: global well-posedness for a family of 

Navier-Stokes -alpha-like models. Nonlinear Anal., 66 (2007), pp. 2427-2458. 
[30] A. P. OSKOLKOV, The uniqueness and solvability in the large of the boundary value problems for 

the equations of motion of aqueous solutions of polymers. Zap. Naucn. Sem. Leningrad. Otdel. Mat. 

Inst. Steklov (LOMI), 38 (1973), pp. 98-136. 
[31] , On the theory of Voight fluids. Zap. Naucn. Sem. Leningrad. Otdel. Mat. Inst. Steklov (LOMI), 

96 (1980), pp. 233-236. 

[32] R. Temam, Fluids driven by its boundary, in Infinite-dimensional Dynamical Systems in Mechanics 
and Physics, F. John, J. Marsden, and L. Sirovich, eds., Springer- Verlag, New York, NY, 1988, ch. 3, 
pp. 116-119. 

[33] , Navier-Stokes equations: Theory and numerical analysis, AMS Chelsea Publications, Provi- 
dence, Rode Island, 2001. ISBN: 0821827375. 

[34] D. Tschumperle and R. Deriche, Vector-valued image regularization with PDEs: A common 
framework for different applications., IEEE Trans. Pattern Anal. Mach. Intell., 27 (2005), pp. 506- 
517. 

[35] Y. You, W. Xu, A. Tannenbaum, and M. Kaveh, Behavioral analysis of anisotropic diffusion 
in image processing, IEEE Trans, on Image Processing, 5 (1996), pp. 1539-1552. 

E-mail address: maebrahi@math . ucsd . edu 

E-mail address: mholst@math.ucsd.edu 
E-mail address: elunasin@math . ucsd. edu 

DEPARTMENT OF MATHEMATICS, UNIVERSITY OF CALIFORNIA SAN DIEGO, LA JOLLA CA 92093 



